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1.  Event  Organization  and  Background. 

Virtual  Reality  Software  and  Technology  '94  (VRST  ’94),  which  is  intended  as 
the  first  in  a  series  of  annual  VR  conferences,  was  conducted  at  the  Institute  of 
Systems  Science  (ISS)  of  the  National  University  of  Singapore  on  23-26  August, 
1994.  VRST  '94  was  co-sponsored  by  ISS  and  the  Association  for  Computing 
Machinery’s  Special  Interest  Group  for  Computer-Human  Interaction 
(ACM/SIGCHI).  The  General  Chair  for  the  conference  was  Dr.  Juzar  Motiwalla, 
Director  ISS.  His  contact  information,  along  with  that  of  Dr.  Steve  Feiner  from 
Columbia  University,  who  served  as  co-chair  of  the  Program  Committee, 
appears  below. 

Dr.  Juzar  Motiwalla 
Director 

Institute  of  Systems  Science 
National  University  of  Singapore 
Heng  Mui  Keng  Terrace 
Kent  Ridge 
Singapore  0511 
Tel:  772-2075 
Fax:  775-0938 
e-mail:  juzar@iss.nus.sg 


Dr.  Steve  Feiner 
Associate  Professor 
Department  of  Computer  Science 
Columbia  University 
New  York,  NY  10027 
Tel:  (212)  939-7083 
e-mail:  feiner@cs.columbia.edu 

The  VRST  '94  technical  program  is  summarized  in  Section  2  below.  As  noted 
there,  the  first  day  of  the  event  (Tuesday  morning,  23  August)  was  devoted  to  a 
collection  of  parallel  tutorial  sessions.  The  primary  conference  technical 
program  began  the  following  morning  (Wednesday,  24  August)  with  the 
program  co-chair  opening  remarks,  guest  speech  and  keynote  address.  The 
remainder  of  the  conference  technical  program  consisted  of  paper, 
demonstration/video  and  panel  sessions.  Abstracts  of  all  presented  papers  are 
included  in  Section  4. 

A  complete  list  of  conference  registrants,  including  affiliation,  is  included  in 
Section  3  below.  Review  of  the  list  indicates  that  VRST  '94  attracted  a  large  and 
diverse  group  of  international  participants.  About  120  people,  representing  15 
different  nationalities,  attended  the  event. 

As  noted  above,  VRST  '94  is  intended  as  the  first  in  a  series  of  annual  virtual 
reality  workshops.  During  the  opening  session,  Tokyo  and  Switzerland  were 
announced  as  the  venues  for  VRST  '95  and  VRST  '96  respectively,  however  no 
specific  dates  were  established  for  either  event. 

2.  Technical  Program  Synopsis. 

The  VRST  '94  technical  program  included  a  full  day  (Tuesday,  23  August) 
devoted  to  virtual  reality  tutorial  sessions.  The  tutorials  were  conducted  in 
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parallel  with  one  full  day  and  four  one  half  day  programs.  The  titles, 
instructors  and  durations  of  the  tutorial  sessions  are  listed  below.  Tutorial 
number  2,  titled  Three  Dimensional  Graphics  Hardware,  was  cancelled  at  the 
conference  site,  but  all  others  were  conducted  as  scheduled. 

Tutorial  1  (Full  Day):  Introduction  to  Virtual  Reality  Design 
Steve  Bryson,  NASA  Ames,  USA 
Steven  Feiner,  Columbia  University,  USA 

Tutorial  2  (Half  Day):  Three  Dimensional  Graphics  Hardware  (Cancelled) 
Tai-cker  Chiueh,  State  University  of  New  York,  Stony  Brook,  USA 

Tutorial  3  (Half  Day):  dVise  -  Using  the  Virtual  Design  Environment(tm) 
with  your  Existing  CAD  Models 
Pierre  duPont,  Division  Limited,  UK 

Tutorial  4  (Half  Day):  Geometrical  Modeling  and  Animation  for  VR 
Mark  Green,  University  of  Alberta,  Canada 

Tutorial  5  (Half  Day):  Graphical  and  Acoustical  Rendering  for  VR 

Peter  Astheimer  and  Stephan  Muller,  Fraunhofer-Institute  for 
Computer  Graphics,  Germany 

The  full  day  tutorial,  titled  Introduction  to  Virtual  Reality  Design  and 
conducted  by  Bryson  and  Feiner,  was  a  very  comprehensive  survey  of  the 
field.  It  included  sessions  on  interface  technology,  human  factors, 
performance  issues,  architectures  and  case  studies.  The  emphasis  throught  was 
on  state  of  the  art  developments.  The  course  handout  material  consists  of  some 
84  pages  of  viewgraph  hardcopy  (two  per  page). 

The  main  conference  program  began  on  Wednesday  morning,  24  August  with 
an  opening  speech  by  Radm.  Teo  Chee  Hean,  Singapore  Minister  of  State  for 
Finance  and  Communications.  Adm.  Hean  addressed  the  conference  in  the 
context  of  virtual  reality  as  a  component  of  Singapore’s  Information 
Technology  national  research  and  development  objectives.  He  indicated  that 
Singapore  considers  information  technology  to  be  a  key  to  its  long  term 
competitiveness  and  intends  to  vigorously  pursue  international  linkage 
opportunities  such  as  VRST  '94  in  the  future. 

The  next  event  on  the  conference  agenda  was  the  keynote  address  (an  abstract 
appears  in  Section  4),  delivered  by  Michael  Deering  from  Sun  Microsystems.  A 
central  theme  of  his  address  was  a  concern  that  the  VR  research  communuity 
might  allow  expectations  to  exceed  what  can  be  delivered.  He  noted  that  about  a 
decade  ago  the  Artifical  Intelligence  community  allowed  something  of  the  sort 
to  happen  to  its  discipline,  with  adverse  consequences.  Other  key  points  in  his 
address  were  that  (1)  successful  commercialization  of  VR  will  require 
somethingh  on  the  order  of  a  $10K  system  which  provides  about  XI. 5 
productivity  improvement  at  about  2hrs/day  utilization  and  allows  a  2  year 
capital  recovery  period,  and  (2)  that  the  VR  research  community  needs  to 
quickly  answer  the  question  "What  is  the  killer  application?" 

The  remainder  of  the  conference  technical  program  was  divided  into  a  series 
of  paper,  panel  and  demonstration/video  sessions.  Abstracts  of  all  presented 
papers,  demonstrations/videos  and  panel  session  opening  remarks  are 
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provided  in  Section  4.  They  are  collected  by  session  title  and  appear  in  the 
order  presented. 

3.  Conference  Registrants. 

Following  is  a  complete  list  of  VRST  '94  conference  registrants,  including 
country  and  organizational  affiliation. 


Countrv 

Name 

Korea 

AHN  Seung  Kwon 

Austria 

AIGNER  Wolfgang 

Singapore 

ANG  Chuan  Heng 

USA 

APPLEWHITE  Hugh 

Germany 

ASTHEIMER  Peter 

Spain 

BAYARRI  Salvador 

UK 

BENJAMIN  Ivor 

USA 

BRYSON,  Steve 

Singapore 

CHAI  Theong  Ham 

Singapore 

CHAN  Hwee  Bin 

Singapore 

CHAN  Wai  Fun 

Singapore 

CHANG  Ivan 

Singapore 

CHIN  Wei  Ngan 

Singapore 

CHIN  Yee  Lin 

Singapore 

CHUA  Beng  Choon 

Singapore 

CLAMTON  Debbie 

UK 

COOPER  Maggie 

Japan 

DAVIS  Thomas 

USA 

DEERING  Michael 

Thailand 

DENISON  Michael  A 

Singapore 

DUSAD  Vishnu 

Singapore 

EICKEMEYER  John  Scott 

Sweden 

FAHLEN  Lennart  Erik 

Singapore 

FAIRCHILD  Kim 

USA 

FEINER  Steven 

USA 

FOXLIN  Eric 

Canada 

GREEN  MarkW 

Singapore 

HAN  Yeow  Kwang  Harry 

Singapore 

HENG  Pheng  Ann 

Singapore 

Hll  Toh  Onn  Desmond 

Japan 

HIROSE  Michitaka 

Sweden 

JAA-ARO  Kai  Mikael 

Germany 

JACOBS  Joerg 

Singapore 

JARZABEK  Stan 

Japan 

JUN  Rekimoto 

Japan 

KAHANER  David  K 

Singapore 

KAN  Chi  Ming 

Singapore 

KAWATAKE  Tsutomu 

Countrv 

Name 

Singapore 

KELLOCK  Peter 

Japan 

KOMORI  Shinya 

Japan 

KUBOTA  Makoto 

Singapore 

KWEE  Tiaw  Joo 

Singapore 

LAU  William 

Singapore 

LEE  Beng  Hal 

Singapore 

LEE  Mong  Li 

Singapore 

LEE  Yiew  Leng 

Singapore 

LEONG  Hon  Wai 

Singapore 

LEONG  Josephine 

Singapore 

LIEWHuiMing 

Singapore 

LIM  David 

Singapore 

LIM  Ik  Soo 

Organization 

GoldStar  Central  Research 
Technische  Universitat  Graz 
National  University  of  Singapore 
Piltdown  Inc 

Fraunhofer-lnstitute  for  Computer  Graphics 

ARTEC 

City  Univ 

NASA  Ames 

Ngee  Ann  Polytechnic 

Defence  Science  Organisation 

Reuters 

Ministry  of  Defence 

National  University  of  Singapore 

Temasek  Polytechnic 

ISS,  National  University  of  Singapore 

Singapore  Polytechnic 

City  University 

USAF  AFOSR/AOARD 

Sun  Microsystems 

Riche  Monde 

Nucleus  Software  Solutions 

National  Computer  Board 

Swedish  institute  of  Computer  Science 

ISS,  National  University  of  Singapore 

Columbia  University 

MIT 

Alberta  University 

Defence  Science  Organisation 

ISS,  National  University  of  Singapore 

ISS,  National  University  of  Singapore 

University  of  Tokyo 

Interaction  &  Presentation  Laboratory 

Art  &  Com 

National  University  of  Singapore 
Sony  Computer  Science  Laboratory  Inc 
US  National  Institute  of  Standards  and 
Technology 
Temasek  Polytechnic 
JSAIC 

Organization 

ISS,  National  University  of  Singapore 
University  of  Tokyo 
Japan  Research  Institute  Ltd 
Ngee  Ann  Polytechnic 
Defence  Science  Organisation 
ISS,  National  University  of  Singapore 
National  University  of  Singapore 
ITS  Technologies  Re  Ltd 
National  University  of  Singapore 
Japan-Singapore  Institute  of  Software 
Technology 

ISS,  National  University  of  Singapore 

Ngee  Ann  Polytechnic 

ISS,  National  University  of  Singapore 
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Singapore 

Singapore 

USA 

Singapore 

Japan 

Singapore 

India 

Singapore 

Germany 

Singapore 

Singapore 

Singapore 

Japan 

Singapore 

Japan 

Singapore 

Singapore 

Singapore 

Singapore 

Singapore 

Singapore 

Singapore 

USA 

Singapore 

India 

Singapore 

Singapore 

Japan 

Singapore 

Singapore 

Singapore 

UK 

UK 

Singapore 

Korea 

Germany 

Canada 

Netherlandslands 

UK 

USA 

Singapore 

Singapore 

Singapore 

Singapore 

Singapore 

Singapore 

Country 

Singapore 

Japan 

Singapore 

Singapore 

Switzerland 

Singapore 

Germany 

UK 

Belgium 

Singapore 

Singapore 

USA 

Korea 
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LIM  Song  Lian  Albert 
LING  Si  Eng 
LIU  Andrew 

LOKE  Kong  Lang,  Michael 
MEYER  Richard  E 
MIKHAILOV  Alexei 
MITRA  Sugata 
MOTIWALLA  Juzar 
MULLER  Stefan 
NG  Hern 
NGTeow  Khoon 
NGUYEN  H  T 
NOMURA  Junji 
NOWINSKI  Weslaw 
OGI  Tetsuro 
ONG  Hian  Leong 
ONG  Lennox 
ONG  Siong  Huat 
PNG  Willie 

POO  Danny  Chiang  Choon 
POSTON  Timothy 
QUEK  Chee  Siong 

QUEK  Francis 
QUEK  Yew  Leng  Steven 
RAWLA  Anuj 
SAKAMOTO  Yoshihiro 
SERRA  Luis 
SHIMI7U  Atsushi 
SHOJI  Hayato 
SIEWTeng  Kean 
SINGH  Gurminder 
SLATER  Mel 
SNOWDON  David 
SOH  Chee  Yuen 
SONG  Kyung  Joon 

SPERLICH  Tom 
STAMPE  Dave 
STAPPERS  Pieter  Jan 
STEED  Anthony 

SU  S  Augustine 
SUNG  Kelvin 
SYN  Peck  Khay 
TAI  Chiew  Lan 
TAN  Chris 
TAN  Gary 
TAN  Lam  Wng 
Name 

TAN  May  Lee 
TANZO  Wiliam 
TEH  Hung  Chuan 
TEO  Ming  Tat 
THALMANN  Daniel 
TOH  Eng  Kheem 
TRAMBEREND  Henrik 
USOH  Martin 

VAN  BINST  Paul 
VANNAKRAIROYN  Surasit 
WEE  Khoon  Hoe  Jarrod 
WEXELBLWT  Alan 
WOHN  Kwangyoen 


Nanyang  Polytechnic 

Ngee  Ann  Polytechnic 

Nissan  Cambridge  Basic  Research 

Ngee  Ann  Polytechnic 

USA  STCFE 

Ngee  Ann  Polytechnic 

NUT  Ltd 

ISS,  National  University  of  Singapore 
Fraunhofer-lnstitute  for  Computer  Graphics 
ISS,  National  University  of  Singapore 
National  Computer  Board 
ISS,  National  University  of  Singapore 
Matsushita  Electric  Works 
ISS,  National  University  of  Singapore 
Mitsubishi  Research  Institute 
Systems  &  Computer  Organisation 
Alliance  Multimedia  Corporation  Re  Ltd 
Defence  Science  Organisafion 
ISS,  National  University  of  Singapore 
National  University  of  Singapore 
ISS,  National  University  of  Singapore 
Japan-Singapore  Institute  of  Software 
Technology 

University  of  Illinois  at  Chicago 
DISC,  National  University  of  Singapore 
V  R  Real  Technologies  (Pte)  Ltd 
JSAIC 

ISS,  National  University  of  Singapore 
Japan  Research  Institute  Umited 
JSAIC 

National  University  of  Singapore 
ISS,  National  University  of  Singapore 
Queen  Mary  &  Wesffield  Univ  of  London 
University  of  Nottingham 
ITS  Technologies 
Electronics  &  Telecommunications 
Research  Institute 

Press 

University  of  Toronto 
Delft  University  of  Technology 
Queen  Mary  &  Westfield  University  of 
London 

Texas  A&M  University 

National  University  of  Singapore 

Defence  Science  Oorganisation 

National  University  of  Singapore 

Ministry  of  Defence 

National  University  of  Singapore 

Ngee  Ann  Polytechnic 

Organization 

Ngee  Ann  Polytechnic 

Saitama  University 

National  University  of  Singapore 

Ngee  Ann  Polytechnic 

Computer  Graphics  Laboratory 

Ngee  Ann  Polytechnic 

Art  &  Com 

Queen  Mary  &  Westfield  University  of 
London 

University  of  Brussels 
Elcom:  Antech  Grp 
ITS  Technologies 
MIT  Media  Laboratory 
KAIST 
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Singapore 

Singapore 

Korea 

Singapore 

UK 


WONG  Yin  Fun.  Audrey 

WOON  See  Chin 

Yl  Geun 

Yll  Buoh  Hing 

YIP  David 


ISS,  National  University  of  Singapore 
ISS,  National  University  of  Singapore 
KAIST 

Ngee  Ann  Polytechnic 
Division  Lid 
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4.  Abstracts  of  Presented  Papers. 

Following  is  a  complete  set  of  abstracts  for  all  papers,  demonstrations/videos 
and  panel  session  opening  remarks  presented  at  VRST  *94.  They  are  collected 
by  session  title  and  in  the  order  presented  at  the  conference. 

Opening  Session: 


Keynote  Address 
FACING  THE  CHALLENGE: 

DELIVERING  VIRTUAL  REALITY 

Michael  F.  Deering 

Sun  Microsystems  Computer  Corporation  2250  Garcia  Avenue 
Mountain  View,  CA  94043,  USA 
michael . deeringSeng . sun . com 

EXTENDED  ABSTRACT 

With  more  than  half  a  decade  of  concept  demonstrations  behind  it,  it  is 
time  for  Virtual  Reality  to  start  facing  up  to  the  challenge  of 
delivering  real  systems.  We  have  to  be  brave  enough  to  state 
quantitatively  what  makes  a  system  Virtual  Reality,  as  opposed  to 
advanced  multimedia  or  just  3D  graphics.  The  field  has  to  find  a  way  to 
be  inclusive  while  still  stating  that  frame  rates  and  lags  that  were 
known  to  be  unacceptable  more  than  200  years  ago  are  still  unacceptable 
today . 

By  definition,  to  grow  beyond  a  niche  market,  technical  appalications  of 
Virtual  Reality  must  be  found  with  broad  market  appeal.  To  be  fiscally 
viable,  the  gains  such  applications  bring  in  end-user  productivity  must 
exceed  any  extra  hardware  costs . 

There  is  room  for  optimism  as  well,  however.  Several  recent  technical 
advances  within  Sun's  VR  effort  will  be  described.  These  include:  nearly 
no-lag  head  tracking,  HoloCam:  a  32-channel  stereo  camera  for  live 
telepresence,  some  recent  dramatic  advances  in  low  cost  high  speed 
rendering  hardware,  and  HoloSketch:  a  completely  VR  based  3D  sketching 
animation  authoring  system.  HoloSketch  is  an  example  of  a  potential  high 
volume  application  for  technical  Virtual  Reality:  a  general  purpose  tool 
for  non-programmers  who  need  to  easily  create  and  manipulate  3D  shapes 
and  worlds . 
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Paper  Session;  Gestures 

NATURAL  GESTURE  IN  VIRTUAL  ENVIRONMENTS 
ALAN  WEXELBLAT 

MIT  Media  Laboratory  20  Ames  St. 

Cantbridge,  MA  02139  USA  wex@media.mit.edu 

I  present  an  experiment  and  the  resulting  prototype  on  a  new  method  for 
interacting  with  virtual  environments.  This  method  involves  the  capture 
and  use  of  natural  empty-hand  gestures.  Users  are  allowed  to  gesture  in 
their  normal  continuous  manner,  rather  than  being  restricted  to  a  small 
set  of  discrete  gestural  commands.  Gestures  are  captured  and  analyzed 
into  a  higher-level  description.  This  description  can  be  used  by  an 
applicationspecif ic  interpreter  to  understand  the  gestural  input  in  its 
proper  context.  An  analyzer  of  this  sort  enables  natural  gesture  input 
to  any  appropriate  application. 


Toward  a  Vision-Based  Hand  Gesture  Interface 
Francis  K.H.  Quek 

Electrical  Engineering  and  Computer  Science  Department 
The  University  of  Illinois  at  Chicago 
1007  SEO,  851  S.  Morgan 
Chicago,  IL  60607 
Correspondence :  quek@eecs . uic . edu 

May  11,  1994 

ABSTRACT 

We  present  a  two-pronged  approach  to  vision-based  gesture  recognition  of 
an  unencumbered  hand.  Our  goal  is  a  gesture  interface  that  makes  sense 
from  the  standpoint  of  human  usage,  and  which  can  be  implemented  by 
machine  vision.  We  first  explore  gesture  interpretation  and  usage  among 
humans.  We  glean  rules  and  principles  which  permit  us  to  define  a 
representative  gesture  taxonomy  and  provide  information  on  gesture 
segmentation  and  usage.  This  analysis  indicates  that  the  dynamics  of 
hand  gestures  are  of  critical  importance  in  their  segmentation  and 
interpretation.  Second,  we  apply  vector  field  computation  to  gesture 
interpretation . 

We  extract  vectors  in  a  three-stage  process.  First,  we  extract  moving 
edges  using  a  motion-enhancing  edge  detector.  Second,  we  compute  an 
initial  vector  field  estimate.  Finally,  we  smooth  this  vector  field  to 
produce  a  locally  aligned  field  which  minimizes  noise.  Results  of  our 
system  indicate  that  the  approach  is  suitable  for  such  interpretation. 

KEYWORDS;  Human-Computer  Interaction,  Gesture  input.  Optical  Flow, 
Dynamic  Vision,  Gesture  Interpretation 


7 


AOARD-TR-94-30 


A  LOGICAL  HAND  DEVICE  IN  VIRTUAL  ENVIRONMENTS  ^ 

S.  AUGUSTINE  SU 

Department  of  Computer  Science,  University  of  Maryland 
College  Park,  Maryland  20742,  USA 

and 

RICHARD  FURUTA 

Department  of  Computer  Science,  Texas  A&M  University  College  Station, 

Texas  77843-3112,  USA 


ABSTRACT 

The  human  hands  are  the  major  means  through  which  we  gain  our  primary 
connection  to  the  world.  The  modeling  of  human  hands  is  a  very  important 
issue  in  virtual  environments,  however  little  research  has  been  done  to 
support  higher  levels  of  abstraction  of  using  hands  beyond  that  of  just 
capturing  raw  data. 

In  this  paper  we  present  an  alternative  view  of  hand  modeling,  i.e.,  a 
point-based  hand  model,  and  then  investigate  3D  static  hand  gestures  in 
detail.  Thereby,  we  develop  a  device-independent  and  general-purpose 
logical  hand  device,  which  supports  the  use  of  comprehensive  3D  gestural 
input  in  virtual  environments.  Based  on  our  logical  hand  device,  not 
only  can  the  implementation  of  "point,  reach,  and  grab"  interaction  be 
facilitated,  but  also  American-Sign-Language-like  static  gestures  can  be 
conceived  easily. 

KEYWORDS:  virtual  environments,  hand  models,  3D  gestures,  logical  hand 
device,  American  Sign  Language 
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Paper  Session;  Modeling  &  Animation 

STEPS  AND  LADDERS  IN  VIRTUAL  REALITY 

MEL  SLATER,  MARTIN  USOH,  ANTHONY  STEED 

Department  of  Computer  Science  and  London  Parallel  Applications  Centre 
Queen  Mary  and  Westfield  College,  University  of  London, 

Mile  End  Road, 

London  El  4NS, 

UK, 

mel@dcs.qmw.ac. uk 
bigfoot@dcs . qmw. ac . uk 
steedQdcs . qmw. ac . uk 


ABSTRACT  This  paper  describes  a  technique  for  walking  through,  and 
climbing  or  descending  steps  and  ladders  in  virtual  reality.  The  idea  is 
that  human  participants  in  the  virtual  reality  (VR)  carry  out  a  whole 
body  gesture  similar  to  walking,  by  walking  in  place.  A  pattern  analyser 
distinguishes  between  walking  in  place  behaviour,  and  any  other 
behaviour,  and  moves  the  participant  through  the  environment  when  it 
detects  the  walking  in  place.  Such  “walking"  while  on  steps  or  ladders 
similarly  causes  appropriate  virtual  movement.  We  discuss  this  in  the 
context  of  a  paradigm  for  interaction  called  "body  centred  interaction 
“ .  This  attempts  to  maximise  the  match  between  the  mental  body  model 
formed  as  a  result  of  proprioceptive  information  generated  by  limb  and 
body  movements,  and  the  sensory  data  displayed  by  the  VR  system,  within 
the  constraints  imposed  by  limited  tracking  information.  We  argue  that 
the  sense  of  presence  in  the  VR  is  enhanced  by  such  body  centred 
interaction  techniques,  and  we  present  experimental  evidence  in  support 
of  this  claim. 


FUZZY  AGGREGATION  OF  MOTION  FACTORS  FOR  HUMAN  MOTION 

GENERATION  1 

JIYUN  LEE 

Strategic  Planning  Team 
Korea  Telecom  Research  Laboratories 
17,  Su-Cho  Ku,  Woo-Myun  Dong,  Seoul,  Korea 

and 

KWANGYEON  WOHN 
Dept,  of  Computer  Science 

Korea  Advanced  Institute  of  Science  and  Technology 
373-1,  Yu-Sung  Ku,  Gu-Sung  Dong,  Taejon,  Korea. 
wohnScs . kaist . ac . kr 

ABSTRACT 

Human  motion  generation  is  one  of  the  important  issues  in  computer  ani¬ 
mation.  To  generate  a  realistic  human  motion,  various  information  of 
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body  joints  are  needed,  and  dynamics  gives  the  solution  to  this. 
However,  formalizing  complex  human  motions  and  solving  these  equations 
are  computationally  expensive.  To  get  an  interactive  and  realistic  human 
motion,  we  made  use  of  dynamic  property  which  allows  to  use  several  key 
human  motion  factors.  In  this  paper,  we  select  four  key  human  motion 
factors  and  propose  an  aggregation  method  using  fuzzy  logic.  We 
implemented  an  animation  system  based  on  this  method,  and  numerous 
experimental  results  showed  that  the  proposed  method  generates  an 
interactive  and  realistic  human  motion.  Such  a  human  motion  generation 
can  be  easily  adapted  in  virtual  reality  systems  that  make  use  of  human 
animation  within  virtual  world. 


A  Geometric  Modeling  and  Animation  System 
for  Virtual  Reality 

Sean  Halliday,  Mark  Green 
Department  of  Computing  Science 
University  of  Alberta,  Edmonton,  Alberta,  Canada  T6G  2H1 

{halliday, mark}@cs .ualberta.ca 

Abstract 

Very  few  virtual  environment  design  tools  have  been  developed  for  non¬ 
programmers.  Most  non -programmers  rely  on  programmers  to  produce  their 
environments,  or  produce  static  environments  using  traditional 
geometrical  modelets.  Non -programmers,  including  artists  and  designers, 
have  a  lot  to  contribute  to  the  development  of  virtual  environments.  In 
addition,  tools  developed  to  assist  this  user  group  will  also  benefit 
other  virtual  environment  developers. 

A  highly  interactive  3D  geometry  modeling  system  and  animation 
editor  {JDCAD+)  is  presented  in  this  paper.  The  motivation  behind  this 
project  is  to  develop  interactive  tools  for  creating  animated  objects 
and  importing  them  into  virtual  environments.  Without  such  tools, 
creating  animated  objects  requires  coding  the  geometry  and  behavior  of 
the  object  manually.  Such  models  are  usually  very  time  consuming  to 
code  and  lack  detail.  Coding  behaviors  for  animation  can  also  be  very 
difficult  due  to  complicated  equations  of  motion  that  need  to  be  solved. 
Using  key  frame  animation  has  resulted  in  faster  and  easier  behavior 
generation . 
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Demonstrations  &  Videos 

UNIVERSITY  OF  ALBERTA  3D  MODELING  TOOLS 

Mark  Green 
Sean  Halliday 
Jiandong  Liang 
Chris  Shaw 

Department  of  Computing  Science,  University  of  Alberta 
Edmonton,  Alberta,  T6G  2H1,  Canada 

ABSTRACT 

Over  the  past  few  years  a  number  of  3D  geometrical  modeling  tools  have 
been  developed  at  the  University  of  Alberta.  The  main  thesis  behind 
these  tools  is  that  3D  design  can  best  be  performed  using  a  3D  user 
interface  with  3D  input  devices.  The  geometrical  modelers  presented  in 
this  demonstration  will  illustrate  this  idea  and  convince  you  that  it  is 
reasonable.  The  first  modeler,  JDCAD,  is  a  CSG  modeler  for  the 
mechanical  engineering  and  industrial  design  communities.  The  second 
modeler,  JDCAD+,  is  an  early  version  of  JDCAD  that  includes  interactive 
behavior  specification.  The  third  modeler,  Thred,  is  an  experimental  two 
handed  free  form  surface  editor. 


Interactive  Visualization  of  a  Beating  Heart: 

A  Medical  Application  of  the  Virtual  Workbench 

S.  Mciyappan  and  Heng  Pheng  Ann 
Centre  for  Information-Enhanced  Medicine 
Institute  of  Systems  Science 
Heng  Mui  Keng  Terrace 
Singapore  0511 

[meiyap@iss.nus. sg,  phengSiss . nus . sgj 


ABSTRACT 

An  interactive  system  for  visualizing  and  manipulating  beating  heart 
data  has  been  enhanced  by  using  the  Virtual  Workbench  interface.  The  new 
system  allows  intuitive  visualization  of  time  and  space  stacks  of  the 
dynamic  cardiac  MRI  data  and  it  also  provides  a  3D  interface  for 
manipulating  such  4D  data. 
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THE  VIRTUAL  ENVIRONMENT  THEATER™  AS  AN  ARCHITECTURAL  AND 
URBAN  DESIGN  REVIEW  SYSTEM 


Peter  C.C.  Wong,  Chet  Dagit,  Robert  Jacobson  Worldesign  Inc.  5348-1/2 

Ballard  Avenue  NW 

Seattle,  WA  98107-4009  USA  +1-206-781-5253  phone,  -5254  fax 
Email:  inf oQwor Ides ign .  com 

In  June  1994,  for  the  annual  A/E/C  SYSTEMS' 94  conference  -  the  building 
industry's  “SIGGRAPH"  -  Worldesign  designed  and  built  a  Virtual 
Environment  Theater,  or  VET™,  as  a  prototypical  virtual  worlds-based 
architectural  and  urban  design  review  system.  Over  3,000  professionals 
in  the  fields  of  architecture,  engineering,  and  construction  (about  a 
tenth  of  the  attendees)  experienced  in  the  VET  several  different 
potential  versions  of  the  Port  of  Seattle's  "Central  Waterfront 
Development  Project",  as  if  they  were  involved  in  an  actual 
environmental  impact  review. 

The  idea  behind  the  VET  is  to  "virtualize",  or  make  more  immediately  ac¬ 
cessible,  the  vast  amount  of  information  contained  in  the  Port  of 
Seattle's  dense  environmental  impact  statement  (EIS).  In  the  United 
States,  issuance  of  an  EIS  usually  precedes  any  major  construction  or 
development.  The  EIS  then  becomes  an  object  of  debate  between 
development  proponents  and  opponents.  The  public,  which  is  supposed  to 
be  the  prime  beneficiary  from  this  process,  is  often  excluded  from  the 
review  since  the  information  contained  in  the  EIS  is  presented  in  arcane 
language  and  without  graphics  or  sound. 

The  VET  permits  representatives  of  the  public  to  better  understand  what 
is  being  proposed  for  a  particular  development  and  the  implications  for 
its  surrounding  natural  and  built  environments.  Information  can  be 
imbedded  in  visual  and  acoustic  objects,  so  that  buildings  can  "speak" 
their  prospective  history  and  effects  when  called  upon.  During  our 
showing  of  the  VET  at  A/E/C  SYSTEMS,  however,  we  discovered  that  the  VET 
has  a  more  essential  use,  to  help  align  the  visions  of  the  various 
parties  -  not  least,  the  clients  -  collaborating  in  the  design, 
building,  and  use  of  a  new  development  or  construction.  Often  the 
failure  to  align  visions  causes  the  greatest  disappointment  (and 
expense)  down  the  line,  when  the  designers,  builders,  and  clients 
suddenly  discover  they  do  not  have  the  same  vision  of  their  common 
enterprise.  In  a  shared  virtual  world,  it  is  easier  to  actively  involve 
everyone  in  the  review  and,  when  necessary,  reformulation  of  basic 
plans,  from  the  beginning.  The  value  of  this  consensus-building  property 
of  the  virtual  environment  cannot  be  overstated. 

The  physical  part  of  the  VET  is  a  large,  multiscreen,  shared  interactive 
virtual  environment.  Up  to  20  persons  can  step  into  the  270-degree  FOV 
space  defined  by  three  4.25  x  3.25-meter  rear-projection  screens.  Each 
screen  is  lit  by  intensely  bright  Hughes-JVC  310  light-valve  video 
projectors.  In  turn,  each  of  the  three  projectors  is  driven  by  a  Digital 
AXP  workstation  paired  with  a  Kubota  Denali  graphics  subsystem;  a  fourth 
Digital  workstation  synchs  up  the  network.  The  Worldspace©,  the  virtual 
world  running  within  the  VET,  is  constructed  of  models  built  in  3D 
Studio,  a  world  framework  provided  by  SenseS ' s  WorldToolKit ,  and 
Worldesign 's  own  proprietary  Reality  Works©  software.  For  our 
installation.  Visual  Synthesis  Inc.  provided  spatialized  sound  and 
Kintek  Stereo  the  sound-surround  apparatus. 
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Dancing  with  the  Virtual  Darvieh  w 

Dervish:  Virtual  Bodies 

School  of  Coranunications,  05-40“™?*;!®“  ^ 

Washington  9819ruSA'''  °*  "“^’’^'’Ston  Seattle, 

with 

oepartpent  of  Theatre??r„o?“",  „  •  . 

Austin,  Teras  Van"  of  Texas 

pro”-e?f  Osroish“pI“?i  Bodies  is  a  coll  H 

^  j9=^u  in  virtual  reality  (VR)  bv  vio.,  i  a  collaborative 

Gromala,  choreographer  YaLv  Sharir  ^^tist  and  designer  Diane 

was  funded  by  a  major  grant  from  ^^"'Poser  Russell  Pinkston  Tr 

srs„?r:?o?TL"?rt?^“::  SLi:'?hT“"" 

remarkable  opportunity.  The  Banff  r  ^  'Virtual  reality,  represented 
collaborative  groups  with  a  team  ot'en?  o«ch  of  the 

“e?eiS?:rt?s???  £  Hr 

perform"''  ?"  *  ^-“^nce^h'ere^hrd,"?  ”“'‘1*'” 

scale  Video  p"oSt1o";??\L\”e?^h'rr““""i"««l-hSe*  Srg?" 


AOARD-TR-94-30 


Paper  Session;  Architectures 

A  USER-DEFINED  VIRTUAL  ENVIRONMENT 

DIALOGUE  ARCHITECTURE 

t  ^  Anthony  Steed  and  Mel  Slater 
I^epartr,ent  "^  ^-P-ter  Science,  Oueen  Mary  and  WestfieM  College 
Mile  End  Road,  London,  El  4NS,  England  ^ 

steedQdcs . gmw. ac . uk 
mel Qdcs .  gmw. ac.uk 

ABSTRACT 

»no„s  th, 

the  virtual  environment  The  dia^  change  how  their  gestures  affect 
representation  within  the  virtual  has  a  visual 

alter  the  gestures  that  are  recogn'ise?‘'"'o^ ''t manipulated  to 
implementation  is  described  and  k  'e  create  new  gestures.  An 


implementing 


designing  in  virtual  REALITY: 

PERCEPTION-ACTION  COUPLING  WITH  APFORDANCES 


Gerda  J.  f.  smets 
Pieter  Jan  Stappers 
Kees  Overbeeke 

Faculty  of  Industrial  Design  Engineering 
P-J. stappers@io. tudelft.nl 
and 


Faculty  of  Informatics 
T  University  of  Technology 

Jaffallan  9,  NL-2628BX  Delft,  The  Netherlands 


ABSTRACT 

ae^ign  package  that  has  been  realTzed  °£  ti" 

that  we  are  aiming  for.  We  believe  that  a  •  ®  .^^aal  mode  of  interaction 
some  advantages  over  designing  with  virtual  reality  has 

describe  these  advantages  in  terms  of  computer  system.  We 

perception,  focusing  on  three  of  the  oon  ecological  approach  to 

first  advantage  is  that  human-product  approach.  The 

second  concerns  the  role  of  perceotinn  ^®^^'=hions  can  be  evaluated.  The 
direct  manipulation,  allowing  des^aner'^t"^  coupling  in  producing  true 

.brceptnnl  ----on  rot  TheTfToTd  “  ef'n^rhrSiU^en^i?:^ 
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The  Virtual  Workbench; 
Dextrous  VR 


Timothy  Poston  and  Luis  Serra 

Centre  for  Information-Enhanced  Medicine 
Institute  of  Systems  Science 
National  University  of  Singapore 
Heng  Mui  Keng  Terrace 

Singapore  0511  (tim@iss.nus.  sg,  luis@iss . nus . sg) 

Abstract 

Skilled  work  in  a  VR  environment  requires  dexterity.  Dexterity  is  more 
easily  achieved  by  embedding  the  virtual  world  in  the  user's  natural 
work  volume  than  by  immersing  the  user  in  a  beyond-arm ' s-reach  virtual 
space.  We  describe  a  cost-effective  means  of  achieving  this,  with  easily 
calibrated  hand-eye  coordination;  a  stereo  display  one  looks  and  reaches 
into.  We  discuss  the  hardware  and  software  environments,  the  calibration 
required,  a  test  for  the  support  of  dexterity,  and  a  preliminary 
application  in  the  manipulation  of  medical  images. 

Keywords:  VR,  dexterity,  hand-eye  coordination,  calibration,  medical. 


Panel  Session;  Enabling  Technologies  for  VR 

Chair:  Daniel  Thalmann 

Swiss  Federal  Institute  of  Technology,  Switzerland 
thalmann@di .epf 1 .ch 

Peter  Astheimer , Fraunhof er-Institute  for  Computer  Graphics  (IGD)  Germany 
Luis  Serra,  National  University  of  Singapore,  Singapore 
Mel  Slater,  Queen  Mary  College,  UK 

Ideally  a  virtual  reality  system  and  application  enables  humans  to  be 
totally  immersed  in  pseudo-real  or  imaginary  virtual  worlds.  This  is 
achieved  technically  by  stimulating  all  human  senses  (see,  hear,  touch, 
taste,  smell)  and  responding  to  human  actions.  An  application  can  be 
qualified  as  totally  immersive  when  the  user  is  not  able  to  distinguish, 
whether  the  world  he  temporarily  inhabitates  is  virtual  or  real. 

Todays  software  and  hardware  technology  is  far  from  a  realization  of 
such  an  idealized  system.  The  graphics  part  of  VR-systems  -  the 
generation  and  display  of  multiple  frames  per  second  -  is  well 
understood  and  suitable  hardware  and  software  systems  generally  satisfy 
our  needs.  Audio  hardware  and  device  controlling  software  is  also 
available  now  (multimedia-  workstations,  Midi -equipment ,  signal 
processor  based  computing  units,  special  devices),  although  mostly  not 
directly  designed  and  applicable  for  VR  purposes.  Force  feedback 
subsystems  and  tactile  displays  are  slowly  being  developed  and 
customized.  The  stimulation  of  the  olfactory  and  gustatory  senses  with 
program  controllable  subsystems  is  still  subject  to  experimentation. 

With  audio  hardware  and  system  software  readily  available  it  is  now 
possible  to  take  the  next  evolutionary  step  and  use  acoustic  simulations 
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of  the  sound  itself,  the  calculation  f"'"  comprises  the  generation 
environment  and  the  subsequent  aurali^  sound  propagation  in  an 

computed  acoustic  parameters.  Up  To  now  aTl  7"*^i"li--tion  of  the 
our  real  world  can  be  simulated  in  TaltLe  i  •  vf"  ®^Perienced  in 
sound  propagation  and  subsequent  3d^  computation  of 

environments.  For  virtual  reality  aoDlioaM  arbitrary 

signal  process  ing  hardwareTsTeSf'TlTT"""'"'  workstations  or 
two  important  human  senses  at  the  same  timT  T  system  addresses 
realism  towards  an  ideal  immersive  svst  ^^‘^^^^ses  the  level  of 

ISDN  rates,  even  with^'Toding  ^T^rel Jt  space.  For  example^ 

produce  full  colour  moving  imagej  at  ^0  f”  “  o>:pensive  to 

alternative  may  be  to  transmit  oniif  f  frames  per  second.  An 

elaborated  by  independent  prograL  at  Ueometry  which  are 

enable  people  to  have  face-to-face  meetinai  nodes.  This  will 

and  exchange  information.  It  requires  nT  ^'  jointly, 

suitable  and  active  representations  of  the°T  bandwidth,  but 

meetings.  Such  representations  should  d'  in  such  virtual 

posture,  but  also  ideally  informatiTlbT^^^-  overall  body 

technology  required  for  virtual  meetinas  th  expression.  Enabling 

internetworking  with  suitable  protoLl^  fo^  includes  both  rapid 

data,  but  also  sensors  that  enable  the  mo  ^  transfer  of  geometric 
emotional  state.  For  an  interaTl  T  behavioural  and 

one,  there  is  no  possibility  of  transferTa  human  and  a  real 

understanding  methods  are  required  T provide  T  structures,  and  image 
perception  of  the  real  human’s  behe!^t  the  virtual  human  with  a 

virtual  and  the  real  humans  requiTT  twT®  interaction  between  the 
them  at  the  geometric  level  at  tn  k  communication  between 

behavioral  level.  At  the  geometricTev:i  To  h""'  "t  the 

allow  the  real  human  to  communicate  anv '  evices  like  a  DataGlove 

virtual  one.  At  the  physical  level,  usina  aT"’®T"'  '^'^tormation  to  the 
a  orque  may  be  communicated  to  a  virtual  ransducer,  a  force  or 

that  may  be  felt  by  the  real  hnmp,r,  human  who  can  apply  a  force 

for  example  possible  to  simulate  the^TT  feedback  device.  It  is 

virtual  human  tug  on  the  two  ends  of  a  ro  animator  and  the 

consider  emotional  communication  between  the  vi  rT  '^® 

one,  for  this  kind  of  emotional  evi-n  •  ^ntual  human  and  the  real 

for  autonomous  virtual  P^Te^^TaTt  T  ^ 

decisions  based  on  perception  svstT  environments  and  making 

virtual  humans  interacting  is  a  closed  sTtT  wT  ^ 

equipping  the  virtual  humans  with  T  i  developed  by 

support  interaction  and  coTunTcation^  -5®-  to 

T?  'recognize-  other  vTiaiT”®  should  be  equipped 

their  facial  expressions,  gestures  an7oT  'perceive- 

no  need  for  real  recognition  oToT  T'  ^^"®'  there  is 

information  from  the  data  structures  that 'dT^°" '  u  course,  because 

virtual  human  can  be  passed  directly  to  a  behaviours  in  one 

irecciy  to  a  second  virtual  human. 


AOARD-TR-94-30 


Invited  Talk; 

Virtual  Reality  Teclmologies  and  its  Applications  to 

Industrial  Use 

Junji  Nomura 

Virtual  Reality  R&D  Group,  Information  System  Center 
Matsushita  Electric  Works,  Ltd. 

1048,  Kadoma,  Osaka  571,  Japan 

Abstract 

Virtual  reality,  a  new  paradigm  for  relationship  between  humans  and 
computers  has  been  recently  well-known  and  currently  investigated  for 
practical  use  in  the  various  industrial  fields.  Using  three-dimensional 
computer  graphics ,  interactive  devices,  and  high-resolution  display,  a 
virtual  world  can  be  realized  in  which  one  can  pick  up  imaginary  objects 
as  if  they  were  physical  world.  Using  this  technology,  Matsushita 
Electric  Works,  Ltd.  has  been  developing  several  application  systems  Jor 
industrial  use  since  1990.  This  paper  details  three  VR  application 
systems  operating  in  the  real  world:  Virtual  Space  Decision  Support 
System  employing  Kansei  Engineering  which  is  applied  for  production  and 
sales  mainly  in  the  system  kitchen  business,  a  telepresence  robot  system 
employing  semi -autonomous  mobile  function  which  is  utilized  for  security 
field  and  a  low-cost  VR  system  employing  physiological  feedback 
mechanism  which  is  used  for  health  care  field. 

Keywords.  Virtual  reality,  DSS,  Kansei  engineering,  Telepresence, 
Security  system.  Mobile  Robot,  Physiological  feedback.  Health  care. 


Paper  Session:  Novel  3D  Techniques  &  Devices 

MULTISENSORY  SCIENTIFIC  DATA  SENSUALIZATION  THROUGH  VIRTUAL  REALITY 

TECHNOLOGY 

TETSURO  OGI 

Advanced  Science  Department,  Mitsubishi  Research  Institute 
2-3-6,  Otemachi,  Chiyoda~ku,  Tokyo  100,  Japan 
E-mail:  tetsu@mri.co.jp 

and 

MICHITAKA  HIROSE 

Faculty  of  Engineering,  University  of  Tokyo 
7-3-1,  Hongo,  Bunkyo-ku,  Tokyo  113,  Japan 

ABSTRACT 

Rapid  advances  in  the  computational  ability  of  scientific  computing 
systems  has  given  rise  to  the  existence  of  vast  amounts  of  data. 


17 


AOARD-TR-94-30 


However,  understanding  complex  phenomena  represented  by  data  through 
conventional  data  visualization  methods  alone  utilizes  only  the  user's 
visual  sensations.  Hence,  in  this  study,  virtual  reality  technology  was 
applied  to  develop  a  multisensory  data  sensualization  method  using 
visual,  acoustic,  and  touch  sensations  to  display  scientific  data.  In 
particular,  a  prototype  wind  sensation  display  system  was  developed  to 
generate  touch  sensations  for  scientific  data.  Scientific  data  was 
represented  in  various  forms  of  physical  stimuli  such  as  color,  sound 
frequency,  and  wind  magnitude.  In  multisensory  data  sensualization, 
accurate  and  efficient  transmission  of  data  from  the  computer  to  the 
user  was  achieved  through  the  effective  integration  of  several 
sensations.  In  this  study,  we  conducted  several  experiments  on  the 
perception  of  scaler  data  and  vector  data  in  three  dimensional  space 
using  multisensory  data  sensualization  methods  and  verified  their 
effectiveness  in  giving  the  user  accurate  perceptions  of  data.  Results 
indicated  that  multisensory  data  sensualization  methods  can  be  applied 
to  effectively  represent  and  display  scientific  data  in  several 
engineering  fields.  In  this  paper,  applications  of  data  sensualization 
to  structural  dynamics  and  fluid  dynamics  were  also  illustrated. 


AN  INERTIAL  HEAD-ORIENTATION  TRACKER  WITH  AUTOMATIC 
DRIFT  COMPENSATION  FOR  USE  WITH  HMD'S 

ERIC  FOXLIN 

Research  Laboratory  of  Electronics,  Massachusetts  Institute  of 

Technology 

Cambridge,  MA  02139,  USA 
emfuchsQirts  .mi t . edu 

and 

NATHANIEL  DURLACH 

Research  Laboratory  of  Electronics ,  Massachusetts  Institute  of 

Technology 

Cambridge,  MA  02139,  USA 
ABSTRACT 

Current  head- tracking  technologies  suffer  from  limitations  such  as 
delay,  limited  range,  vulnerability  to  interference,  1 ine-of-sight 
requirements  and  high  cost.  In  principle,  the  methods  of  Inertial 
Navigation  Systems  (INS),  applied  to  head-tracking,  could  overcome  these 
problems.  However,  inertial  head-tracking  has  been  largely  neglected  due 
to  the  difficulty  of  making  a  small,  light  INS  that  does  not  drift  too 
much.  In  order  to  evaluate  the  suitability  of  inertial  sensors  for  use 
in  virtual  environment  and  teleoperator  head-tracking  applications,  an 
inertial  head-orientation  tracker  has  been  built  and  bench-tested  for 
accuracy,  resolution,  noise,  and  latency.  Yaw,  pitch  and  roll  of  the 
head  are  computed  by  Euler  integration  of  the  outputs  of  three 
orthogonal  angular  rate  sensors.  Drift  compensation  is  accomplished  by 
making  use  of  natural  pauses  in  head  motion  to  obtain  stable  readings 
from  a  two-axis  fluid  inclinometer  and  a  fluxgate  compass.  The  system 

O 

achieves  0.1  ms  lag,  0.008  angular  resolution,  and  an  unrestricted 
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working  volume.  The  pitch  and  roll  axes,  using  a  fluid  inclinometer  for 
drift  compensation,  achieve  1  angular  accuracy.  The  drift  compensation 
of  the  yaw  axis  using  a  compass  has  not  yet  been  evaluated.  The  results 
indicate  excellent  potential  for  the  use  of  inertial  technology  in  head¬ 
tracking,  and  work  is  under  way  to  extend  the  system  to  6  degrees  of 
freedom. 


A  NEW  ULTRASONIC  POSITIONING  PRINCIPLE  YIELDING  PSEUDO-ABSOLUTE  LOCATION 

HUGH  L.  APPLEWHITE 
Piltdown  Inc 

4470  SW  Hall  Boulevard,  M/S  Beaverton,  OR  97005  USA 
hughaQteleport . com 

ABSTRACT 


Modulated  Phase  Coherence  (MPC)  is  a  new  VR  positioning  principle.  The 
advantages  of  MPC  include  pseudo-absolute  position  determination  and 
direct  measurement  of  velocity.  MPC  uses  temporal  or  spatial  modulation 
of  a  carrier  wave  to  remedy  one  of  the  primary  drawbacks  of  Phase 
Coherent  (PC)  systems,  the  lack  of  absolute  position  determination. 
Basic  MPC  positioning  principles  are  described  along  with  Doppler  effect 
compensation.  Three  implementation  approaches  are  analyzed.  The  positive 
features  of  the  PC  approach,  high  data  rates  over  large  volumes,  low 
lag,  and  good  environmental  noise  immunity,  are  retained.  The  intended 
audience  is  knowledgable  in  systems  and  software,  but  not  necessarily  in 
signal  processing  or  communications.  Emphasis  is  on  the  interaction  of 
geometry  and  signal  properties. 
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A  STUDY  ON  THE  SYNTHESIS  OF  ENVIRONMENTAL  SOUNDS 
MICHITAKA  HIROSE  SHIN’YA  KOMORI 
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and 

TOSHIKI  NAGUMO 

Computer  and  Communication  Research  Center,  Tokyo  Electric  Power  Co., 

Inc. 

1-4-10,  Irifune,  Chuo-ku,  Tokyo  104,  Japan 
Abstract 

HRTF{Head  Related  Transfer  Function) -based  acoustic  display  systems  have 
been  studied  in  parallel  with  the  development  of  virtual  reality 
technology.  However,  their  initial  intended  function  was  only  to  display 
the  point  sound  sources  to  the  user  in  three-dimensional  virtual  space. 
Hence,  this  provided  motivation  to  design  and  develop  a  new  sound  field 
display  system,  which  could  reproduce  complex  and  widespread 
Environmental  Sound  Fields  (ESF)  with  a  high  degree  of  realism.  To 
develop  this  system,  the  understanding  of  the  behaviour  of  sound  waves 
is  crucial.  Thus,  an  ESF  display  system  along  with  the  application  of 
sound  and  noise  principles  was  developed  and  tested.  The  simulation 
results  were  used  to  generate  theoretical  diagrams  of  the  sound  waves 
generated  by  point  sound  sources.  Secondly,  an  experimental  prototype 
spea)cer  system  was  developed  and  accurately  tested  in  terms  of  auditory 
localization.  Furthermore,  the  ESF  display  system  was  implemented  into 
two  virtual  reality  devices.  Creation  of  these  graphs  and  experimental 
results  provided  better  understanding  into  the  behaviour  of  the  ESF 
display  system  and  the  subjects  with  respect  to  integration  with 
conventional  virtual  reality  devices. 


Invited  Talk; 

virtual  Environments  in  Scientific  Visualization 

STEVE  BRYSON 

Computer  Sciences  Coporation 
Numerical  Aerodynamic  Simulation  Systems  Division 
NASA  Ames  Research  Center 
Moffett  Field,  Ca . 
bryson@nas . nasa . gov 

ABSTRACT 

The  use  of  virtual  environment  (virtual  reality)  techniques  for 
scientific  visualization  are  surveyed.  Lessons  learned  from  vanous 
existing  applications  are  stated,  with  regard  to  implementation  areas 
such  as  computation,  graphics,  data  management,  and  user  interface.  The 
fruitful  interplay  of  virtual  reality  and  scientific  visualization  is 
stressed . 
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Paper  Session:  Designing  Effective  Virtual  Worlds 

MANAGING  MUTUAL  AWARENESS  IN 
COLLABORATIVE  VIRTUAL  ENVIRONMENTS 


STEVE  BENFORD 

Department  of  Computer  Science,  The  University  of  Nottingham, 

Nottingham,  NG7  2RD,  UK 

JOHN  BOWERS 
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LENNART  E.  FAHLEN 
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CHRIS  GREENHALGH 

Department  of  Computer  Science,  The  University  of  Nottingham, 

Nottingham,  NG7  2RD,  UK 

ABSTRACT 

This  paper  introduces  a  spatial  model  of  interaction  which  aims  to 
support  groups  of  people  in  using  their  natural  coinmunication  skills  in 
distributed  virtual  environments.  First,  we  outline  our  motivation  for 
undertaking  this  work  in  terms  of  the  social  significance  of  space  in 
supporting  co-operative  work.  Next,  we  summarise  the  model's  main 
concepts,  namely  aura,  awareness,  focus,  nimbus,  adapters  and 
boundaries.  Following  this,  we  describe  routes  to  implementing  the 
model.  The  first  is  an  approach  suited  to  realising  the  model  as  an 
application  of  existing  VR  platforms.  The  second  is  a  general 
implementanon  of  the  model,  based  on  its  own  specially  tailored 
distributed  architecture.  Finally,  we  present  our  initial  observations 
from  use  in  the  laboratory  setting  and  outline  issues  for  future  work.  1 


REAL  TIME  GRAPHICS  AND  VIRTUAL  REALITY 
FOR  DRIVING  SIMULATION  IN  URBAN  ENVIRONMENTS 
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FRANCISCO  ROSICH 
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Valencia  46010,  Spain.  Rosich@glup.eleinf.uv.es 

ABSTRACT 

The  rising  interest  in  the  development  of  medium-size  driving  simulators 
with  high  performance  level  is  leading  to  the  research  in  Virtual 
Reality  techniques  incorporating  this  technology.  The  spatial  and 
temporal  complexity  of  the  urban  environment  has  not  been  broached  by 
existing  driving  simulators,  and  it  offers  a  good  test  field  to  the 
behavioral  simulation  algorithms,  real  time  graphics  management  and  VR 
interaction.  This  paper  presents  a  method  to  manage  an  urban 
environment  complex  database,  making  use  of  hierarchical  elision 
techniques  over  a  spatial  connectivity  network.  It  is  also  shown  how  to 
adapt  and  refine  traffic  microsimulation  algorithms  to  provide  visual 
quality  in  a  local  area  (SMAL  algorithm)  and  it  is  exposed  the 
connection  performed  between  SMAL  and  a  macroscopic  qualitative 
simulator  (QS)  .  Different  techniques  to  achieve  a  real  time  3D  rear 
mirror  view  capability  are  explained. 


ENVISIONMENTS-CONSTRUCTING  DRAMATIC  VIRTUAL  WORLDS 
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London  ECIV  OHB,  United  Kingdom 

ABSTRACT 

If  virtual  worlds  are  to  fulfil  their  promise  as  stages  for 
entertainment,  education  and  artistic  endeavourr,  with  who  or  what  shall 
we  people  them??  And  what  methods  are  available  to  us  to  design  the 
dramatic  elements  of  these  worlds?  Both  drama  and  virtual  realities  are 
multi-modal  experiences.  By  drawing  on  crossover  research  between  the 
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disciplines  of  theatre,  HCI  and  system  design,  we  put  forward  an 
innovarive  basic  framework  for  the  design  of  virtual  worlds  -  an 
envisionment .  This  paper  will  examine  the  nature  of  interactive 
experience  in  relation  to  user  viewpoint  and  identity,  and  will  develop 
a  frame  of  reference  for  the  structure  and  composition  of  virtual  worlds 
in  dramatic  terms:  location  and  environment,  content,  actions,  time- 
scale,  events,  metaphysical  structures  and  characters.  We  shall  draw 
attention  to  the  significance  of  constraints  and  potentials  to 
envisionment  and  to  techniques  drawn  from  object-oriented  analysis  and 
design  to  model  them.  We  hope  that  this  paper  will  stimulate  a 
discussion  of  the  issues  raised  and  future  directions  for  research. 

Keywords:  Virtual  Reality,  Virtual  Worlds,  Drama,  Human-Computer- 
Interaction,  System  Design. 


Panel  Session;  Hands  Off  My  VR:  The  Role  of  Gestures  in  VR 

Chair:  Mark  Green 
University  of  Alberta,  Canada 
Steve  Bryson,  NASA  Ames,  USA 

Timothy  Poston,  National  University  of  Singapore,  Singapore 
Alan  Wexelblat,  MIT  Media  Lab,  USA 


1.  Introduction 

What  is  the  role  of  hands  in  VR?  We  use  our  hands  to  interact  with 
objects  in  the  real-world,  suggesting  that  hands  are  the  natural  input 
device  for  VR.  But,  is  this  the  case?  Most  input  devices  require  the  use 
of  at  least  one  hand,  the  main  issue  is  how  the  hand  is  used  to  interact 
with  the  device.  In  the  case  of  a  glove,  the  input  device  attempts  to 
mimic  the  actions  of  the  user's  hand,  so  the  user  can  use  his  or  her 
hand  in  a  natural  way.  For  the  purpose  of  this  panel  session  we  will 
call  this  gesture  based  input.  Other  types  of  input  devices,  such  as 
buttons  mounted  on  a  3D  tracker,  can  be  viewed  as  tools  that  the  user 
manipulates  with  his  or  her  hand.  In  this  case  the  input  device  doesn't 
attempt  to  mimic  a  hand.  For  the  purposes  of  this  panel  session  we  will 
call  this  tool  based  input. 

Now  comes  the  question,  which  is  best,  gesture  based  or  tool  based 
input?  There  have  been  no  detailed  studies  done  on  either  style  of 
interaction  and  we  still  have  very  limited  experience  with  the  use  of 
these  devices,  thus  this  is  an  excellent  topic  for  a  panel  session. 
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Science  Fiction  writes  about  technology  that  is  still  in  the  Goofy 
Prototype  stage,  this  is  why  Virtual  Reality  is  so  popular  now. 

Bruce  Sterling,  Armadillo  Con,  1990,  Austin,  Texas. 

Abstract 

Virtual  reality  researchers  are  developing  technologies  to  deal  with 
current  device  limitations.  But  even  with  the  accompanying  advances  in 
raw  computer  power,  VR  application  designers  will  always  want  just  a  bit 
more  power  to  make  their  virtual  objects  even  more  convincing.  What  we 
need,  along  with  the  device  advances,  is  software  advances  that  'solve' 
the  computationally  expensive  problems.  One  is  efficiently  determining 
if  two  objects  are  touching,  which  is  known  as  the  collision  detection 
problem.  A  prototype  system  has  been  built  that  provides  support  for 
collision  detection  in  real-world  applications.  The  Virtual  Collision 
detection  algorithm  scales  up  to  handle  tens  of  thousands  of  virtual 
objects  and  uses  order  n  memory  and  CPU  resources.  It  supports  teams  of 
users  in  worlds  containing  objects  accessible  at  various  resolutions. 
The  algorithm  can  also  be  directly  extended  to  solve  other  problems  such 
as  view  management . 

This  paper  describes  the  algorithms  from  a  conceptual  and  implementation 
standpoint.  Simulation  results  are  then  presented. 


Virtual  and  Real  object  Collisions  in  a  Merged  Environment 
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ABSTRACT 

See-through  head-mounted  display  capability  is  becoming  an  important 
part  of  Virtual  Environment  applications.  In  such  applications,  it  may 
be  desirable  to  model  the  physical  behavior  of  the  virtual  objects  and 
their  interaction  with  the  real  objects.  This  paper  describes  a  software 
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system  which  integrates  interactive  collision  detection,  collision 
response  and  see-through  headmounted  displays .  The  system  employs  a 
static  model  of  the  real  world  environment  and  allows  for  arbitrary 
convex  virtual  objects  to  be  placed  in  the  environment.  The  user  may 
control  the  positions  and  velocities  of  the  virtual  objects.  An 
approximately  constant  time  collision  detection  algorithm  and  a 
Newtonian  Mechanics  based  single  point  contact  collision  response  is 
used  to  model  the  apparent  physical  interaction  of  the  virtual  and  real 
objects  for  moderately  complex  environments. 

Keywords:  Virtual  Reality,  See-through  Head-Mounted  Displays,  Collision 
Detection,  Dynamics,  Parallel. 


LEVEL-OF-DETAIL  GENERATION 
AND  ITS  APPLICATION  IN  VIRTUAL  REALITY 
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Wilhelminenstr.  7,  64283  Darmstadt,  Germany 
email:  astheimeQigd.fhg.de 

ABSTRACT 

Virtual  worlds  have  to  be  presented  in  realtime  in  order  to  enable 
interactive  control,  viewing  and  object  manipulations.  The  performance 
of  graphics  workstations  is  limited  in  the  maximum  number  of  polygons 
which  can  be  processed  in  realtime.  Complex  world  models  (which  are  of 
prime  interest)  exceed  this  limit  easily.  A  set  of  rendering  techniques 
allow  to  handle  and  conquer  complex  worlds,  where  level-of -detail 
techniques  prove  to  be  most  promising  and  successful.  This  paper 
introduces  an  interactive  tool  with  a  set  of  methods  for  the  generation 
of  multiple  levels -of -detai 1  of  objects,  demonstrates  several  examples 
and  the  application  within  IGD's  proprietary  VRSystem  "Virtual  Design". 
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